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ABSTRACT 

Background: Memantine is licensed for moderate-to- 
severe Alzheimer's disease (AD). National Institute for 
Clinical Excellence (NICE) guidance does not 
recommend the use of memantine in combination with 
cholinesterase inhibitors (acetylcholinesterase 
inhibitor (AChEl)). The underpinning meta-analysis 
was disputed by the manufacturer. 
Objectives: To compare the efficacy of AChEl 
monotherapy with combination memantine and AChEl 
therapy in patients with moderate-to-severe AD and to 
examine the impact of including unpublished data on 
the results. 

Design: Systematic review and meta-analysis of 

randomised controlled trials. 

Data sources: The Cochrane Dementia Group trial 

register, ALOIS, searched for the last time on 3 May 

2011. 

Data synttiesis: Data from four domains (clinical 
global, cognition, function, behaviour and mood) were 
pooled. Sensitivity analyses examined the impact on 
the NICE-commissioned meta-analysis of restricting 
data to patients with moderate-to-severe AD and of 
including an unpublished trial of an extended release 
preparation of memantine. 
Results: Pooled data from the trials, which were 
included in the NICE-commissioned meta-analysis but 
which were restricted to moderate-to-severe AD only, 
showed a small effect of combination therapy on 
cognition (standardised mean difference 
(SMD)=-0.29, 95% CI -0.45 to -0.14). Adding data 
from an unpublished trial of an extended release 
memantine (total three trials, 1317 participants) 
showed a small benefit of combination therapy on 
global scores (SMD=-0.20, 95% CI -0.31 to -0.09), 
cognition (SMD=-0.25, 95% CI -0.36 to -0.14) 
and behaviour and mood (SMD=-0.17, 95% 
CI -0.32 to -0.03) but not on function (SMD=-0.04, 
95% CI -0.21 to 0.13) at 6 months. No clinical data 
have been reported from a 1-year trial, although this 
found 'no significant benefit' on any clinical measures 
at 1 year. 

Conclusions: These results suggest that there may be 
a small benefit at 6 months of adding memantine to 
AChEls. However, the impact on clinical global 
impression depends on exactly which studies are 
included, and there is no benefit on function, so its 
clinical relevance is not robustly demonstrated. 
Currently available information from randomised 



ARTICLE SUMMARY 



Article focus 

■ To compare the efficacy of AChEl monotherapy 
with combination memantine and AChEl therapy 
in patients with moderate-to-severe AD. 

■ To examine the impact of including unpublished 
data on the results. ^ 

Key messages 

■ Combination AChEl and memantine therapy is 
of greater benefit in AD than AChEls alone, 
but the clinical relevance depends on exactly 
which studies are included so is not robustly 
demonstrated. 

■ Unpublished data in registry postings can still 
obscure important negative clinical findings. 

■ International harmonisation of reporting of all 
clinical variables is needed. 

Strengths and limitations of this study 

■ Systematic review including sources of 
unpublished data. 

■ Not all relevant data were available for 
meta-analysis. ^^^^^^^^^^^^^^^ 



controlled trails indicates no benefit of combination 
therapy over monotherapy at 1 year. Legislation on the 
form and content of registry posted results is needed 
in Europe. 



INTRODUCTION 

Two classes of drugs are licensed by the 
European Medicines Agency for the treat- 
ment of Alzheimer's disease (AD): acetyl- 
cholinesterase inhibitors (AChEls) for mild- 
to-moderate disease and memantine for 
moderate (Mini-Mental State Examination 
(MMSE) 10-19) and severe disease (MMSE 
<10).^ Memantine is a moderate affinity non- 
competitive NMDA receptor antagonist, 
which blocks the effects of tonic pathologi- 
cally elevated levels of glutamate that may 
lead toneuronal dysfunction. It has a small 
but consistent effect, but its place in therapy 
has been controversial in Europe. 
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Both National Institute for Clinical Excellence (NICE) 
and IQWiG (the German Institute for Quality and Effi- 
ciency in Healthcare) have revised their original 
conclusions that there was insufficient evidence to 
recommend memantine as a monotherapy for AD.^""* 
Following the release of IQWiQ's original report in 
2009,"^ the manufacturer of 'Axura' memantine, Merz, 
submitted a responder analysis, presenting data from 
two previously excluded unpublished trials, IE2101 and 
MD-22. Despite initially stating that this analysis could 
not be used,"^ IQWiG revised their conclusion and in 
2011 reported that the new data provided proof of 
a benefit of memantine on cognition in AD/ 

The NICE currently recommends the use of meman- 
tine in severe disease or as a second-line treatment in 
moderate disease for patients who are intolerant or have 
a contraindication to AChEIs. However, it does not 
recommend the use of memantine in combination with 
AChEIs, stating that there is 'a lack of evidence of 
additional clinical efficacy compared with mono- 
therapy'.^ This contrasts with the conclusions of a recent 
company-sponsored non-systematic review,*' which 
asserts that it is "safe, well-tolerated, and may represent 
the current gold standard for treatment of moderate- 
severe AD and possibly mild-to-moderate AD as well." 
Memantine does not have a licence for mild AD, and 
evidence is lacking for a clinical benefit in this group.' 

In the meta-analysis, which informed the guidance 
(TA217)," two trials are included in the analysis of 
combination therapy.^ Data for cognitive and activities 
of daily living (ADL) /function outcomes were contro- 
versially not pooled on the grounds that different 
scoring systems were used by the included trials. Pooled 
analyses in the other domains (global and behavioural) 
showed no benefit. A further source of dispute was that 
data from patients with mild AD in one of the trials (MD- 
12)^** were included despite the separate availability of 
data (in Winblad et al (2007)^^) for just the subgroup of 
patients with moderate AD, which falls within the 
licensed indication. 

As part of a Cochrane review, we conducted a systematic 
review, meta-analysis and sensitivity analyses to examine 
the impact of these issues and of the inclusion of 
unpublished data on the efficacy of combination 
memantine and AChEI therapy in moderate-to-severe AD. 

IVIETHODS 
Search methods 

ALOIS, the Cochrane Dementia and Cognitive Improve- 
ment Group's comprehensive, free access register of 
trials'^ that contain records from all relevant sources, was 
searched for the final time on 3 May 2011. The search 
terms used were memantine, D-145, DMAA, DRG-0267, 
ebixa, abixa, axura, akatinol, memox and namenda. 
ALOIS is maintained by the Trials Search co-ordinator 
and contains studies in the areas of dementia prevention, 
dementia treatment and cognitive enhancement in 
healthy participants. The studies are identified from: 



1. Monthly searches of a number of major healthcare 
databases: MEDLINE, EMBASE, CINAHL, PsycINFO 
and LILACS. 

2. Monthly searches of a number of national and 
international trial registers: ISRCTN; UMIN (Japan's 
Trial Registry); ICTRP/WHO portal (which covers 
ClinicalTrials.gov; ISRCTN; the Chinese Clinical 
Trials Register; the German Clinical Trials Register; 
the Iranian Registry of Clinical Trials and the 
Netherlands National Trials Register, plus others). 

3. Quarterly search of The Cochrane Library^ Central 
Register of Controlled Trials (CENTRAL). 

4. Six-monthly searches of a number of grey literature 
sources: ISI Web of Knowledge Conference Proceed- 
ings; Index to Theses; Australasian Digital Theses. 

Details of the search strategies used for the retrieval of 
reports of trials from the healthcare databases, from 
Cochrane CENTRAL and from conference proceedings 
can be viewed in the 'Methods used in reviews' section 
within the editorial information section of the Dementia 
and Cognitive Improvement Group's website. ^'^ 

Additionally, the clinical trials registries of Lundbeck, 
Forest and the Japanese registry the Japanese Pharma- 
ceutical Information Centre, the websites of the US Food 
and Drug Administration, the European Medicines 
Agency, NICE and press releases of manufacturers 
(Lundbeck, Merz, Forest, Suntori, Asubio, Daiichi) and 
all conference posters of studies sponsored by Merz, 
Lundbeck and Forest presented in 2004—2009 were 
studied in detail. Authors and companies were contacted 
directly with requests for missing information. A full 
account of the search strategy is available in the full 
Cochrane review from which this paper is drawn. 

Trial inclusion criteria 

Trials were included if they were (1) double-blind, 
parallel group, placebo-controlled randomised trials of 
memantine in patients with moderate-to-severe AD who 
were taking AChEIs, (2) sample selection criteria were 
specified and diagnosis used established criteria and (3) 
outcome instruments were specified. 

Data extraction 

We extracted clinical and demographic characteristics 
and outcome data relating to patients with moderate and 
severe AD from the trial reports and, where not available 
from primary reports, from a company-sponsored meta- 
analysis, which was conducted during the European 
regulatory review process. The data were extracted 
independently by at least two people, and discrepancies 
were resolved by discussion. The outcomes of interest 
were clinical global impression, cognitive function, func- 
tional performance in ADL and mood and behavioural 
disturbance. These were assessed using instruments, 
including the Clinician's Interview-Based Impression of 
Change plus caregiver's input (CIBIC-plus), the 
Alzheimer's Disease Assessment Scale— Cognitive subscale 
(ADAS-Cog) and Severe Impairment Battery (SIB), the 
Alzheimer's Disease Cooperative Study— Activities of Daily 
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Living (ADCS-ADL) scale (19- and 23-item) and the 
Neuropsychiatric Inventory (NPI). 

Data synthesis and analysis 

Data from each of the four clinical domains were pooled 
separately, and a random-effects model ( DerSimonian- 
Laird) was used to estimate differences between groups. 
Effect sizes were presented as standardised mean differ- 
ences (SMDs) — the absolute mean difference divided by 
the SD — with 95% CIs and p values, calculated using 
Revman V.5.0 software/^ This meant that data could be 
pooled when different rating scales (eg, SIB and ADAS- 
Cog) were used to assess the same outcome. In the 
TA217 assessment report, all effect sizes were presented 
as weighted mean differences (WMDs), and data were 
not pooled when included trials used different rating 
scales. In this review, we have replicated the findings of 
the TA217 report for comparison, presenting them first 
as WMDs (as in the original report) in analysis la, and 
then as SMDs in analysis lb. 

Sensitivity analyses were performed to examine the 
effect sizes in the NICE-commissioned assessment 
report*^ in comparison with those derived from all avail- 
able data, which are as follows: 

la. Replication of TA2I7 assessment report analysis, 

presented as WMDs. 
lb. Replication of TA217 assessment report analysis, 

presented as SMDs for comparison. 

2. Pooled data from trials included in the TA2I7 
assessment report, presented as SMDs, excluding 
data from patients with mild disease. 

3. As in 2, but from all trials meeting our inclusion 
criteria. 

RESULTS 

Description of studies 

Five trials were identified (MD-02,^ MD-12,^" MD-SO,^"^ 
LulOII2"' and DOMINO-AD^'') that met inclusion 
criteria, of which three (MD-02,^ MD-12^° and MD-50^^) 
were included in this meta-analysis. Of these, MD-02 and 
MD-I2 were included in the TA2I7 assessment report 
analysis of memantine combination therapy.^ One 
trial (MD-02 ) was of patients with moderate-to-severe 
disease (MMSE range 5—14, average score 10. 0) and 
another trial (MD-I2^") was of mild-to-moderate disease 
(MMSE range 10—22, average score 16.9). Data for the 
subgroup of patients in MD-I2 with moderate AD 
were available through a published company-sponsored 
meta-analysis.^^ MD-50^''' studied an extended release 



(ER) preparation of 28 mg/ day, which has recently been 
granted a licence by the US Food and Drug Adminis- 
tration^*^ but is not currently marketed in the USA, is not 
licensed in Europe and would have been ineligible for 
inclusion in the NICE meta-analysis. 

Two 12-month trials (LuI0II2^'^ and DOMINO-AD^') 
of combination therapy that met trial inclusion criteria 
were excluded from this review. First, a randomised 
controlled trial (LuI01I2^'') of 277 paUents with 
moderate AD in which the primary was an imaging 
outcome, and in which 72% of patients were taking an 
AChEI, was completed in February 2009. A conference 
poster in September 2009^^ and a registry posting in May 
2010^*' did not report details of important clinical data 
(ADAS-Cog, Neuropsychiatric Inventory, time to institu- 
tionalisation) but reported that there was no significant 
benefit of memantine on these measures at 12 months. 
The cut-off point for inclusion in the TA2I7 meta-anal- 
ysis was March 2010.** Total brain atrophy rates were 
greater in those taking combination therapy than in 
those taking memantine alone. Second, data were not 
yet available from the DOMINO-AD trial, which 
includes comparison of monotheraphy and combination 
therapy and is due to report shortly. 

Participants 

The total number of participants was 1317. All patients 
were diagnosed with AD, classed as mild, moderate or 
severe disease based on their MMSE score. Table 1 shows 
the baseline characteristics of participants. 

Interventions 

MD-02 and MD-I2 compared the efficacy and safety of 
adding 20 mg/ day memantine with placebo in patients 
receiving stable treatment with donepezil (an AChEI). 
MD-50 compared the efficacy and safety of adding an ER 
preparation of 28 mg/ day memantine, equivalent to 
20 mg daily, with placebo in patients receiving a stable 
dose of any cholinesterase inhibitor. 

Outcome measures 

The primary outcomes of interest were clinical global 
impression, cognitive function, functional performance 
in ADL and behavioural and mood disturbance. 

Quality of included studies 

The commercially sponsored studies conducted after 
1993 are likely to have conformed to International 
Conference on Harmonisation Good Clinical Practice 



Figure 1 Clinical global (CIBIC- 
plus). ChEl, cholinesterase 
inhibitor; ER, extended release; 
LOCF, last observation carried 
forward; OC, observed case; 
SMD, standardised mean 
difference. 



study or subgroup 



Memantine + ChEl ChEl monotherapy SMD 
Mean SD Total Mean SD Total Weight IV, Random, 95% CI 



SMD 

IV, Random, 95% CI 



MD-02n"ariot 2004 ' 4.41 1.04 198 4.66 

MD-12/Porsteinsson/Modsti° 4.47 0.98 135 4.51 
MD-50/Grossberg2008t'= 3.8 1.2 333 4.1 

Total (95% CI) 666 

Heterogeneity: t'=0.00; x'=2.19, df=2 (p=0.33); P=9% 
Test for overall effect: Z=3.47 (p=0.0005) 

* LOCF; 20 mg daily 

t From Winblad e( al 2007"; OC; 20 mg daily 

t Unpublished registry data; LOCF; 28 mg ER preparation 
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-0.24 (-0.44 to -0.04) 
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649 100.0% -0.20 (-0.32 to -0.09) 
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Figure 2 Cognition (ADAS-Cog 
and SIB). CliEl, cholinesterase 
inhibitor; ER, extended release; 
LOCF, last observation carried 
forward; OC, observed case; 
SIVID, standardised mean 
difference. 



study or subgroup 



Memantine + ChEl ChEl monotherapy 



SMD 

IV, Random, 95% CI 



MD-02/Tariot 2004*' 
MD-12/Porsteinsson/Modst '° 
MD-50/Grossberg2008*'^ 


-0.9 9.43 

0.85 5.95 
-2.7 11.1 
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133 
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5.77 
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50.5% 


-0.36 (-0.55 to -0.16) 
-0.19 (-0.44 to 0.05) 
-0.21 (-0.37 to -0.06) 
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-0.25 (-0.36 to -0.14) 
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Test for overall effect: Z=4.54 (p<0.00001 ) 
* SIB: LOCF: 20 mg daily 

t From Winblad et si 2007^ ' ; ADAS-Cog: OC; 20 mg daily 
X Unpublished registry data; SIB; LOCF; 28 mg ER preparation 
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Standard and to have been at low risk of bias with regards 
their sequence generation, allocation concealment and 
methods of blinding. In the included studies, the char- 
acteristics of the treatment and placebo groups were well 
balanced at baseline (table 1). The risk of bias of the 
included studies was judged to be low as indicated in the 
'risk of bias' tables in the main Cochrane Review from 
which this systematic review is derived. 

Results of individual studies 

Of the three included studies, MD-02^ showed a signifi- 
cant benefit of combination therapy (memantine plus 
AChEI) compared with AChEI monotherapy on cogni- 
tion, ADL, global outcome and behaviour. Combination 
therapy was well tolerated. showed no advan- 

tage of combination therapy compared with AChEI 
monotherapy in any domain in the overall group of 
patients with mild as well as moderate disease. There 
were no significant differences in safety or tolerability 
between the two groups. Data from the subset of patients 
in MD-12^*' with moderate disease were taken from the 
meta-analysis by Winblad et al (2007)." MD-BO^"^ showed 
a statistically significant improvement from combination 
memantine ER plus AChEI therapy compared with 
AChEI monotherapy ER on cognition, global improve- 
ment and behaviour, but not on function, after 
6 months. Memantine ER was well tolerated. 

Results of synthesis of studies 

The synthesis of data from trials of memantine combi- 
nation therapy is summarised in table 2 and figures 1—4. 
Analysis la shows the analysis conducted in TAI27. 
Analysis lb shows that had TAI27 pooled cognitive and 
functional data across different instruments using 
standardisation; there would still have been no domains 
where combination therapy was significantly better than 
AChEI monotherapy. Analysis 2 shows the impact of 
excluding data from patients with mild disease: there was 



a small (SMD==-0.29, 95% CI -0.45 to -0.14) signifi- 
cant benefit of memantine combination therapy on 
cognition but not on any other outcome. Analysis 3, the 
most inclusive analysis, shows that when data from the 
memantine ER trial (MD-50^''') was also pooled, the small 
benefit on cognition persisted (SMD=— 0.25, 95% CI 
—0.36 to —0.14), and there were also small significant 
benefits of combination therapy on the global improve- 
ment score (SMD=-0.20, 95% CI -0.32 to -0.09) and 
on behaviour and mood (SMD=-0.I7, 95% CI -0.32 to 
-0.03) but not on function (SMD=-0.04, 95% CI -0.21 
to 0.13). 

DISCUSSION 

This systematic review and meta-analysis suggests a small 
but significant benefit of memantine combination 
therapy on cognitive, global and behaviour measures, 
but not on function/ADL, when data from all included 
trials, including one trial of ER memantine, were pooled. 
When data from the trials included in the TA217 meta- 
analysis, but from patients with moderate-to-severe 
disease only, were pooled, there was a small, significant 
benefit of combination therapy on cognition 
(SMD=0.29). This effect size is comparable to that seen 
for memantine monotherapy. However, since the impact 
on clinical global impression depends on exactly which 
studies are included, and there is no benefit on function, 
the clinical relevance of combination therapy is not 
robustly demonstrated. 

Clinical data from a negative 1-year trial, which would 
have been available at the time of the NICE meta-anal- 
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ysis, remain unpublished. The DOMINO study is due 
to report shortly. Whether pooling of these 1-year studies 
would show a robust effect on clinical global remains to 
be seen. 

Data for patients with moderate AD from one trial^*' 
were only available as observed case data,^^ and it was 
necessary to pool these with the last observation carried 



Figure 3 Function (ACDS- 
ADLig and ADCS-ADL23). ChEl, 
cholinesterase inhibitor; ER, 
extended release; LOCF, last 
observation carried forward; OC, 
observed case; SIVID, 
standardised mean difference. 



study or subgroup 



Memantine + ChEl ChEl monotherapy SIVID 
Mean SD Total Mean SD Total Weight IV, Random, 95% CI 



MD-02/Tariot2004 " 2 7.04 

MD-12/Porsteinsson/Modst'° 3.63 7.01 
MD-50/Grossberg 2008* -0.7 6.9 



198 
136 
331 

665 



3.4 



-1.3 



7.16 197 
7.99 125 
7.7 328 



Total (95% CI) 

Heterogeneity: i'=0.01; x'=4.79, df=2 (p=0.09); P=58% 
Test for overall effect: Z=0.46 (p=0.65) 

* LOCF: ADCS-ADL,g; 20 mg daily 

t From Winblad et a/ 2007"; OC; ADCS-ADL ; 20 mg daily 



33.0% 
27.1% 
39.9% 



-0.20 (-0.39 fo 0.00) 
-0.03 (-0.27 fo 0.21) 
0.08 (-0.07 to 0.23) 



650 100.0% -0.04 (-0.21 to 0.13) 



SMD 

IV, Random, 95% CI 



-0.5 -0.25 0 0.25 0.5 
Favours memantine + ChEl Favours ChEl monotherapy 
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Figure 4 Behaviour and mood 
(NPI). ChEl, cholinesterase 
inhibitor; ER, extended release; 
LOCF, last observation carried 
forward; OC, observed case; 
SMD, standardised mean 
difference. 



study or subgroup 



Memantine + ChEl ChEl monotherapy SMD 
Mean SD Total Mean SD Total Weight IV, Random, 95% CI 



SMD 

IV, Random, 95% CI 



MD-02/Tariot 2004*^ 

MD-12/Porsteinsson/Mods+" 

MD-50/Grossberg2008*'^ 



-0.1 13.61 
0.97 11.26 
^.3 14.6 



193 3.7 

136 0.86 

318 -1.6 

647 



13.61 189 
11.08 125 
12.7 321 



32.1% 
25.1% 
42.8% 



-0.28 (-0.48 to -0.08) 
0.01 (-0.23 to 0.25) 
-0.20 (-0.35 to -0.04) 



Total (95% CI) 

Heterogeneity: t'=0.01; x'=3.31, df=2 (p=0.19); l==40% 
Test for overall effect: Z=2.30 (p=0.02) 

* LOCF, 20 mg daily 

t From Winblad ef a/ 2007^ ^ OC; 20 mg daily 

t Unpublished registry data; LOCF; 28 mg ER preparation 



635 100.0% -0.17 (-0.32 to -0.03) 



-1 -0.5 0 0.5 1 

Favours memantine+ ChEl Favours ChEl monotherapy 



forward data from the other trials,^ which is not 
methodologically ideal. In the full Cochrane review, this 
strategy was shown to have no material effect on results. 
The last observation carried forward treatment of 
missing data is a conservative approach because dropout 
rates are equivalent or slightly favour memantine. 
Consideration of the cost-effectiveness of combination 
AChEI and memantine was outside the scope of this 
review. 

To the extent that we foimd a significant benefit of 
combination therapy on cognition, our analyses of the 
available data contrast with the findings of the TA217 
report,*^ which found no evidence of additional benefit 
of combination therapy. The explanations given by the 
Peninsula Technology Assessment Group (PenTAG) for 
not pooling data from the same clinical domain ("it is 
not valid to synthesise these data on their original 
scales"**) or for not restricting analyses to data from the 
licensed patient subgroup ("The upper range of the 
MMSE scores for the participants of this study was 

20.37 this was only minimally over the threshold 

of 20 (so we) include(d) this study. . .")^'* remain 
controversial. 

The inclusion of unpublished registry data on the ER 
preparation extends the evidence of benefit of combi- 
nation therapy at 6 months. The dose of 28 mg 
memantine in this preparation was designed to be 
equivalent to 20 mg daily of the currently marketed 
preparation.^^ However, the trend for an adverse effect 
on ADL may account for the fact that these data have not 
been published in peer review literature. Although there 
is biological plausibility to the possibility of dose-related 
adverse effects of memantine^^ and memantine is asso- 
ciated with more rapid neurological decline in cogni- 
tively impaired patients with multiple sclerosis, ^'^ 
memantine is well tolerated over 6 months, with slightly 
fewer dropouts in the memantine than placebo arms, 
and long-term open-label follow-up studies do not 
suggest an obvious safety signal. ^''^^ There are no long- 
term, randomised placebo-controlled studies to address 
this issue directly. 

Nevertheless, we find the benefit of combination 
therapy to be less convincing than other reviewers,*' 
primarily because important data are missing from 
registry posting of trial results. Posting of clinical data is 
not mandatory for trials sponsored by companies who are 
not the Marketing Authorisation Holder in the USA. 
However, the fact that clinical data have not been released 



from the 12-month trial, Lul0112,^^ is disturbing for two 
reasons. First, cerebral atrophy rates were greater in those 
taking combination therapy than in those taking 
memantine alone. While the presented analysis suggests 
that this unexpected finding of increased atrophy was 
attributable to the AChEI rather than the memantine, 
there is no information about whether this is reflected in 
the clinical domains. Second, the reason given for not 
posting the clinical data is revealing: sponsors who are not 
marketing authorisation holders in the USA are not 
obligated by US public law 110-85. This law mandates the 
posting of defined clinical data items on registries within 
a year of study completion. 

The greatest benefit of registries is ensuring the 
timeliness of the release of results. Without this, there 
are obvious incentives to delay the release of negative 
data until as close to the end of patent life as possible. 
However, registries are likely to become the preferred 
repository of incomplete or negative data. This makes it 
particularly important that harmonising legislation 
specifies in detail which clinical data must be posted. 
Furthermore, until there is harmonisation onto a single 
registry, such as clinicaltrials.gov, systematic reviews 
should routinely include comprehensive searches across 
all registries. 
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